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Abstract 
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1 Problem statement 



Consider a game with m > 2 players indexed by i G {1, . . . ,m}. The strategy x% of the ith 
player lies in a real Hilbert space Hi and the problem is to find x\ G Hi, . . . , x m G H m such that 

(Vi G {1, . . . ,m}) Xi G Argmin /(xi, . . . , x^i, x, x i+ i, . . . , x m )+gi(xi, . . . ,x^i,x,x i+ i, . . . ,x m ), 

(1.1) 

where (<7j)i<i< m represents the individual penalty of player i depending on the strategies of all 
players and / is a convex penalty which is common to all players and models the collective 
discomfort of the group. At this level of generality, no reliable method exists for solving (jl.ip 
and some hypotheses are required. In this paper we focus on the following setting. 

Problem 1.1 Let m > 2 be an integer and let /: Hi © ••• © H m — > ]— oo,+oo] be 
a proper lower semicontinuous convex function. For every i G {l,...,m}, let g i : Hi © 
■■■ H m —> ]— oo,+oo] be such that, for every (xi, . . . ,x m ) G Hi © ••• © H m , the func- 
tion x i-> Qi(xi, ■ ■ ■ , Xi-i, x, Xi+i, . . . , x m ) is convex and differentiable on Hi, and denote by 
Vjgij(xi, . . . ,x m ) its derivative at x,. Moreover, 

(V(xi, . . . , xm) G Hi © • • • © H m ) (V(yi, . . . , y m ) G Hi © ■ ■ ■ © H m ) 

m 

^2 (Viflfj(a;i, . . . ,x m ) - VjffjO/i, . . . ,y m ) | 

i=l 

The problem is to find xi £ Hi, . . . , x m G H m such that 

xi G Argmin f(x,x 2 , ■ ■ ■ ,x m ) +g 1 (x,x 2 , ■ ■ ■ ,x m ) 

x<=Hi 

< : 

x m G Argmin f(x 1 , . . . ,x m -i,x) + g m (xi, . . .,x m -i,x). 

x€Hm 

In the special case when, for every i G {1, . . . , m}, g i = g, Problem 11.11 amounts to finding 
a Nash equilibrium of a potential game, i.e., a game in which the penalty of player i can be 
represented by a common potential / + g [13]. Hence, Nash equilibria can be found by solving 

minimize f(xi, . . . ,x m ) + g(xi, . . . , x m ). (1.4) 

I'll 

Thus, the problem reduces to the minimization of the sum of two convex functions on the Hilbert 
space Hi © • • • © H m and various methods are available to tackle it under suitable assumptions 
(see for instance [5j Chapter 27]). In this paper we address the more challenging non-potential 
setting, in which the functions (gi)i<i< m need not be identical nor convex, but they must satisfy 
(|1.2p . Let us note that (|1.2p actually implies the convexity of cjj with respect to its ith variable. 

Our methodology consists in using monotone operator splitting techniques for solving an 
auxiliary monotone inclusion, the solutions of which are Nash equilibria of Problem II. li In 
Section [2] we review the notation and background material needed subsequently. In Section [3] 
we introduce the auxiliary monotone inclusion problem and provide conditions ensuring the 



- Vi) > 0. (1.2) 



(1.3) 
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existence of solutions to the auxiliary problem. We also propose two methods for solving Prob- 
lem [TTT] and establish their convergence. Finally, in Section H] the proposed methods are applied 
to the construction of generalized Nash equilibria, to zero-sum games, and to cyclic proximation 
problems. 



2 Notation and background 

Throughout this paper, H, Q, and (Hi)i<i< m are real Hilbert spaces. For convenience, their 
scalar products are all denoted by (• | •} and the associated norms by || • ||. Let A: U -> 2 n 
be a set-valued operator. The domain of A is dom^l = jx G H | Ax ^ 0}, the set of zeros 
of A is zer A = {x G % | G Ax}, the graph of A is gra^4 = {(x, u) G % x H | u G Ac}, the 
range of A is ran^4 = \u G % | (3i E 11 G Ar}, the inverse of A is the set- valued operator 
A^ 1 : Ti — >2^:ui— s^jxG'H | u G ^4x}, and the resolvent of A is Ja = (Id In addition, 

^4 is monotone if 

(V(x,y) eH xH){V{u,v) £ Ax x Ay) (x - y \ u - v) > (2.1) 

and it is maximally monotone if, furthermore, every monotone operator B: T~L — > 2^ such that 
gr&A C grai? coincides with A. 

We denote by r'o('H) the class of lower semicontinuous convex functions 92: H — > ]—oo, +00] 
which are proper in the sense that domip = jx G % | ^(x) < +00} 7^ 0. Let 99 G To(^). The 
proximity operator of if is 

prox : % — > % : x i-> argmin y?(y) -\ — ||x — yj| 2 (2-2) 

yen 2 

and the sub differential of ip is the maximally monotone operator 

dip: H -> 2 W : x i-> {u G U | (Vy G (y - x | «) + (p(x) < <f(y)}. (2.3) 

We have 

Argmin ip(x) = zer dip and prox = Jg^. (2-4) 

Let /3 G ]0, +oo[. An operator T: T~L — > % is /3-cocoercive (or f3T is firmly nonexpansive) if 

(Vx G %)(Vy G %) (x-y\Tx-Ty)>p\\Tx-Ty\\ 2 , (2.5) 

which implies that it is monotone and /3 _1 -Lipschitzian. Let C be a nonempty convex subset 
of H. The indicator function of C is 

fo, if x G C; . , 

i C : H^]-oo,+oo] : x^ { ' (2.6) 

[+00, ■& x f.C 

and 3tc = Ac is the normal cone operator of C, i.e., 

»r „, w flu G H I (Vy G C) (y - x I u) < 0), if x G C; 

0, otherwise. 
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If C is closed, for every x E H, there exists a unique point Pqx € C such that \\x — Pc%\\ = 
infygc \\x — y\\; Pqx is called the projection of x onto C and we have Pc = prox tc . In addition, 
the symbols — 1 and — > denote respectively weak and strong convergence. For a detailed account 
of the tools described above, see [5]. 

3 Model, algorithms, and convergence 

We investigate an auxiliary monotone inclusion problem the solutions of which are Nash equi- 
libria of Problem 11.11 and propose two splitting methods to solve it. Both involve the proximity 
operator prox^, which can be computed explicitly in several instances [5j[7]. We henceforth de- 
note by 1-L the direct sum of the Hilbert spaces (^i)i<i< m , i-e., the product space Hi x • • • x T-L m 
equipped with the scalar product 

in 

({■ | •}) : ((xi)i<i< m , (yi)i<i<m) >->• (xj | Vi). (3.1) 

i=l 

We denote the associated norm by ||| • |||, a generic element of H by x = (xj)i<j< m , and the 
identity operator on T-L by Id . 

3.1 A monotone inclusion model 

With the notation and hypotheses of Problem 11.11 let us set 

A = df and B-.U^-H: (V igi {x),...,V m g m (x)). (3.2) 
We consider the inclusion problem 

find x£zer(A + B). (3.3) 

Since / 6 Tq(H), A is maximally monotone. On the other hand, it follows from (|1.2|) that 
B is monotone. The following result establishes a connection between the monotone inclusion 
problem (|3.3p and Problem 1 1.1 1 

Proposition 3.1 Using the notation and hypotheses of Problem \l.l\ let A and B be as in ()3.2p . 

Then every point in zer(A + B) is a solution to Problem \l.l[ 

Proof. Suppose that zer(A + B) ^ and let (x±, . . . ,x m ) G H. Then [5] Proposition 16.6] 
asserts that 

A(xi, x m ) C d(f(-,x 2 , . . • , x m j) (x x ) x • • • x d(f(x 1 , . . . , x m - 1} •)) (x m ). (3.4) 
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Hence, since domg 1 (-,X2, ■ ■ ■ ,x m ) = Tii, domg m (ii,...,%_i,-) = H m , we derive from 
dSZD , ([Z3D , and Corollary 16.38(iii)] that 

(xi, . . . ,x m ) G zer(A + B) 4$ -B(xi, . . . ,x m ) £ A(x 1 , . . . ,x m ) 

-V 1 g 1 (x 1 , . . . ,x m ) G d(f(-,x 2 ,...,x m ))(xi) 

i X-m—lj ' ) ) \Xm ) 

<^ (xi,...,x m ) solves Problem [TTJ (3.5) 

which yields the result. □ 

Proposition 13.11 asserts that we can solve Problem II .11 by solving (|3.3p . provided the latter 
has solutions. The following result provides instances in which this property is satisfied. First, 
we need the following definitions (see [5] Chapters 21-24]). 

Let A: H — > 2^ be monotone. Then A is 3* monotone if domi x ran A C dom Fa, where 
Fa - H x % — )• ]— oo, +oo] : (x, u) (->• (x \ u) — inf (x — y \ u — v). (3-6) 

(y,v)egva,A 

On the other hand, A is uniformly monotone if there exists an increasing function 0: [0, +oo[ — > 
[0, +oo] vanishing only at such that 

(V(x, y) ETixTi) (V(n, v) G Ax x Ay) (x - y \ u - v) > <j)(\\x - y\\). (3.7) 

A function (p G Tq(T-L) is uniformly convex if there exists an increasing function 0: [0, +oo[ — > 
[0, +oo] vanishing only at such that 

(\/(x,y) G domip x dom93)(Va G ]0, 1[) 

ip(ax + (1 — a)y) + a(l — a)0(||x — y||) < cap(x) + (1 — a)(p(y). (3.8) 

The function <f> in (|3.7p and (|3.8p is called the modulus of uniform monotonicity and of uniform 
convexity, respectively, and it is said to be supercoercive if lim^+oo 4>(t)/t = +oo. 

Proposition 3.2 With the notation and hypotheses of Problem \l.l\ let B be as in (|3.2p . Sup- 
pose that B is maximally monotone and that one of the following holds. 

(i) 1 i m |||x|||-H-oo im? lll<9/(a;) + Bx\\\ = +oo. 

(ii) df + B is uniformly monotone with a supercoercive modulus. 

(iii) (dome?/) ndomB is bounded. 

(iv) / = be, where C is a nonempty closed convex bounded subset ofH. 

(v) / is uniformly convex with a supercoercive modulus. 

(vi) B is 3* monotone, and df or B is surjective. 
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(vii) B is uniformly monotone with a supercoercive modulus. 

(viii) B is linear and bounded, there exists ft E ]0, +oo[ such that B is /3-cocoercive, and df or 
B is surjective. 



Then zer(<9/ + B) ^ 0. In addition, if (ii) (v) , or (vii) holds, zer(<9/ + B) is a singleton. 



Proof. First note that, for every x = (xj)i<j< m £ H, dom Vi^ 1 (-,X2, 



T-L m ■ Hence, it follows from (13,21) that dom B 



• 5 •^m) — "H-lj • • • j 
H and, therefore, 

from Corollary 24.4(i)] that df + B is maximally monotone. In addition, it follows from 
Example 24.9] that df is 3* monotone. 



dom V m g m (xi, . 



(iv) 



(i) This follows from [51 Corollary 21.20]. (ii) This follows from Corollary 23.37(i)]. 
Since dom(d f + B) = (dom9/)ndomB, the result follows from [51 Proposition 23.36(iii)]. 
l c £ To('K) and dom 5/ 



(iii) 



(v) => (ii) It follows from ||32P and 



/ = tc £ ro("H) and dom 5/ = C is bounded, 
xample 22.3(iii)] that 3/ is uniformly monotone. Hence, df + B is uniformly monotone 

Clear 



(vT)J This follows from Corollary 24.22(h)] 
[5J Proposition 24.12]. □ 



(vii) => (ii) 



(viii) =^ (vi) : This follows from 



3.2 Forward-backward-forward algorithm 



Our first method for solving Problem 11.11 derives from an algorithm proposed in [6], which is 
itself a variant of a method proposed in [15]. 

Theorem 3.3 In Problem \l.l[ suppose that there exist (zi, . . . , z m ) € H. such that 
- Vi 

9l { z l j • • • ) Zm ), . . . ,V m g m (zi, . . . , z m )) £ df(zi,...,z m ) (3.9) 
and x € ]0, +oo[ such that 

(y(x l ,...,x m ) eU)(y(yi,...,y m ) en) 

m m 

^2\\^i9i(xi,---,x m ) -Vi9i(yi,...,y m )\\ 2 < x 2 J2^ Xi ~^H 2 - ( 3 - 10 ) 



i=i 



i=i 



Let e € ]0,l/(x + l)[ and let (7 n ) n eN be a sequence in [s, (1 — e)/x]- Moreover, for every i 6 
{l,...,m} ; /e£ rr^o E and /ei (aj )n ) ne N; (^,n)neN, and (cj jn ) ng N &e absolutely summable 
sequences in Hi. Now consider the following routine. 



(Vn G N) 



For i = 1, . . . , m 

L yi,n — n l/ni^i 9i\p^\,ni > • • j ^m,n) "I - ^i,n) 
(Pl,n, • • • ,Pm,n) = Prox 7n/ (?/i 

,n ) • • • ; ym,n ,n i ■ ■ • j bm,n) 

For i = 1 , . . . , m 

Qi,n — Pi,n ^ni^i 9i(Pl,m • • • i Pm,n) ~i~ Cj,n) 



(3.11) 



Then there exists a solution (xi, . . . , x m ) to Problem li.il swc/i £/za£ 7 /or every i G {1, . . . , m}, 
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Proof. Let A and B be denned as (|3,2p . Then (|3.9j) yields zer(A + B) 7^ and, for every 
7 € ]0, +oo[, ()2,4p yields J^a = prox 7 j. In addition, we deduce from (|1.2p and (|3,10p that B is 
monotone and x~Lipschitzian. Now set 



(Vn G N) 
Then (|3.1ip is equivalent to 





— (^1, rn • 


• • 1 %m,n) 






= (yi, n , ■ 


■ 1 ym,n) 


and 


Pn 


= (Pl,n, ■ 


• ) Pin,n) 




Qn 


= (qi,n, ■ ■ 


• ) Qm,n) 





O-n — \p>\,ni • • • 1 ®>m,n) 
bn — (Pl,ru ■ • • ; b m ,n) 
n — ipX,ni ■ • • j Cm,n)' 



(Vn G N) 

Therefore, the result follows from [61 Theorem 2.5(h)] and Proposition 13.11 □ 



y n = x n - "f n (Bx n + a n ) 

Pn = J^nAVn + bn 
Qn = Pn ~ ln(Bp n + C n ) 
x n+l = x n ~ V n ' Qn- 



(3.12) 



(3.13) 



Note that two (forward) gradient steps involving the individual penalties (f/j)i<j<m and 
one (backward) proximal step involving the common penalty / are required at each iteration of 

43H]). 



3.3 Forward-backward algorithm 



Our second method for solving Problem ll.ll is somewhat simpler than (|3.1ip but requires stronger 
hypotheses on (gi)i<i< m . This method is an application of the forward-backward splitting 
algorithm (see [31 [8] and the references therein for background) . 



Theorem 3.4 In Problem \l.ll suppose that there exist {z\, . . . , z m ) € H. such that 
- Vi 

9l (^1 > ■ ■ ■ i %m j Zm ) 

and x € ]0, +oo[ such that 

, y m ) e U) 

x m ) - Vi gi(yi, ...,y m ) I a?» - y,) 



(3.14) 



(V(xi, . . .,x m ) G 'H)(V(yi, 



. m 

> - V] l|Viflfj(xi,. . .,x m ) - Vifir^yi, . . . ,y m )|| 2 . (3.15) 



Let e E ]0,2/(x + l)[ and let (7 n )„ e N be a sequence in [e, (2 — e)/x\- Moreover, for every 
i € {1, ... , m}, Ze£ x^o € Hi, and let (ai, n )neN (fr«,n)ngN absolutely summable sequences 
in Hi. Now consider the following routine. 



(Vn G N) 



For i = 1, . . . , m 

L — ^i.n 7n(V <7j(xi jn , . . . , X mn ) + Q.j jfl ) 



(3.16) 



(s 



l,n+l) 



,n+i) = prox 7ri/ (yi 

,71) • • • ) ym,n ,«)•••) b m n ) . 
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Then there exists a solution (xi, . . . , x m ) to Problem li.il such that, for every i G {1, . . . , m}, 
%i,n 51 and Vj Qi(x\^ ni . . . , x min ) y Vj {x\ , . . . , 1™). 

Proof. If we define A and -B as in (|3.2p . (|3.14p is equivalent to zer(A + £?) 7^ 0, and it follows 
from (|3.15p that B is x _1 ~ c o coerc i ve - Moreover, f)3. 16|) can be recast as 



(Vn G N) 



x n+l = J~f n AUn "n- 



The result hence follows from Proposition 13.11 and Theorem 2.8(i)&(ii)]. □ 

Theorem 13.41 imposes more restrictions on {gj)i<i< m - However, unlike the forward- 
backward-forward algorithm used in Section [3.21 it employs only one forward step at each iter- 
ation. In addition, this method allows for larger gradient steps since the sequence (7 n )neN lies 
in ]0,2/x[, as opposed to ]0, l/x[ i n Theorem! 



4 Applications 

The previous results can be used to solve a wide variety of instances of Problem ll.il We discuss 
three examples. 

4.1 Saddle functions and zero-sum games 

We consider an instance of Problem 11.11 with m = 2 players whose individual penalties gf 1 and 
g 2 are saddle functions. 

Example 4.1 Let \ G ]0,+oo[, let / G r o (^i0^ 2 ), and let C: Hi®H 2 -> K be a differentiate 
function with a x-Lipschitzian gradient such that, for every x\ G Hi, C{xi, •) is concave and, 
for every X2 G H 2 , C(-,x 2 ) is convex. The problem is to find xi G %i and X2 € %2 such that 

xi G Argmin f(x, x 2 ) + C(x, x 2 ) 

l€Ml (4.1) 
x 2 G Argmin /(xi, x) — £(a;i, a;). 

x£H 2 



Proposition 4.2 /n Example \4-l\ suppose that there exists (zi,z 2 ) G Hi @H 2 such that 

(-ViC{zi,z 2 ),V 2 C{zi,z 2 )) edf(zi,z 2 ). (4.2) 

Let e G ]0, l/(x + 1)[ and let (7 n ) ne N &e a sequence in [e, (1 — e)/x\- Moreover, let (xi i o,x 2 fl) € 
Hi ®H 2 , let (ai jn ) ne N; (&i,n)neN; an <^ (ci,n)neN & e absolutely summable sequences in Hi, and 
let (a2,n)neN; (^2,n)ngN; (c2,n)neN be absolutely summable sequences in H 2 . Now consider 
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the following routine. 



(Vn G N) 



Vl,n = X 1>n - 7n(Vl C(x 1>n , X 2 , n ) + a\,n) 
V2,n = X 2 ,n + 7n(V 2 C(x 1>n , X 2j „) + &2,n) 

,niU2,n) + {pl,m°2,n) 
qi,n = Pl,n ~ 7n(Vl £(pi,n,P2,n) + Cl )TV ) 
<?2,n = P2,n + 7n(V 2 £(jPl,n,P2,n) + C 2 , n ) 
Sl,n+1 = ^l,n - Ul,n + <?l,n 
X2,n+1 = X 2 , n ~ V2,n + Q2,n- 



Then there exists a solution {x\,x\) to Example \4-1\ such that x\ >n — v X\, pi <n 
and p 2 ,n x 2 . 



(4.3) 



xi, x 2 . 



X2, 



Proof. Example 14.11 corresponds to the particular instance of Problem 11.11 in which m = 2, 
gi = £, and g 2 = — £. Indeed, it follows from [14|, Theorem 1] that the operator 

(xi,x 2 )^ (V 1 C(x 1 ,x 2 ),-V 2 £{x 1 ,x 2 )) (4.4) 

is monotone in Hi © H2 and hence (|1.2p holds. In addition, (|4.2p implies (|3.9|) and, since V £ 
is x~Lipschitzian, (|3.10p holds. Altogether, since ()3.1ip reduces to (|4.3p . the result follows from 
Theorem I3J3J □ 



Next, we examine an application of Proposition 14.21 to 2-player finite zero-sum games. 

Example 4.3 We consider a 2-player finite zero-sum game (for complements and background 
on finite games, see [IS]). Let Si be the finite set of pure strategies of player 1, with cardinality 
N\, and let 

Ni ^1 



Ci 



CC?)i<j<^ e [0,1]^ 



1 



(4.5) 



be his set of mixed strategies (S 2 , N 2 , and C 2 are defined likewise). Moreover, let L be an 
iVi x N2 real cost matrix such that 



(3z 1 €C 1 )(3z 2 €C 2 



LZ2 G Nc±z\ and L G Nc 2 %2- 



(4.6) 



The problem is to 

find xi G M^ 1 and x 2 G 1 % such that 



x\ G Argmin x T Lx 2 
x 2 G Argmax xj Lx. 

X&C 2 



(4.7) 



Since the penalty function of player 1 is (xi,x 2 ) h-> xj Lx2 and the penalty function of player 
2 is (x±,x 2 ) (->■ —xjLx 2 , (|4.7|) is a zero-sum game. It corresponds to the particular instance of 



Example 14. II in which Hi 



\H 2 = R N2 , f : (x 1 ,x 2 ) ^ L Cl (xi) + ic 2 (x2), and £: (xi,x 2 ) H> 



x{ Lx 2 . Indeed, since C\ and C 2 are nonempty closed convex sets, / G Tq(Hi ®H 2 )- Moreover, 
x\ i — ^ £(xi,x 2 ) and x 2 (->■ — £(xi,x 2 ) are convex, and V£: (xi,x 2 ) (->■ (Lx 2 ,L T xi) is linear 
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and bounded, with ||V£| 
Proposition 23.30]. Hence, 



(Vn G 



L\\. In addition, for every 7 G ]0,+oo[, prox 7 ^ = (-Pci j -Ffaa ) [3 
31) reduces to (we set the error terms to zero for simplicity) 



Vl,n = Xl,n - JnLx 2 ,n 
U2,n = X 2 ,n + 7nL T X^ n 
Pl,n = PdV^n 
P2,n = Pc 2 V2,n 
qi,n = Pl,n ~ lnLp2,n 
Q2,n = P2,n + In'L 1 P\,n 
a?l,n+l = Xl,n ~ yi,n + Ql,n 
%2,n+l = X2,n ~ V2,n + <?2,n, 



(4. 



where (7 n )neN is a sequence in [e, (1 — e)/||L||] for some arbitrary e G ]0, 1/(||L|| + 1)[. Since 
df: (xi,X2) Nc x x\ x Nc 2 X2, (|4.6p yields (|4.2p . Altogether, Proposition 14.21 asserts that the 



sequences (xi, n )neN and (x 2 ,n)neN generated by 
respectively, such that (xi,x 2 ) is a solution to (|4.7p 



SJ) converge to x\ G l Wl and x 2 G 



4.2 Generalized Nash equilibria 



We consider the particular case of Problem 11.11 in which / is the indicator function of a closed 
convex subset of "H = %\ @ ■ ■ ■ ffi Tim- 

Example 4.4 Let C C H be a nonempty closed convex set and, for every i G {l,...,m}, 
let g i : — > ]— 00, +00] be a function which is differentiable with respect to its ith variable. 
Suppose that 

(V(xi, . . . ,x m ) G H) (V(yi, . . . ,y m ) G U) 

m 

^2(^i9i(xi,...,x m ) - Viflfj(yi,...,y m ) | X, - j/i) > (4.9) 



and set 



(V(xi, . . . ,x m ) G 'H) < 



Qi(x 2 , • • • , x m ) = {x G %i I (x, x 2 , . . . , x m ) G C} 



(4.10) 



^Qm^b • • • j X m _l) — {x G % m I (Xl, . . . , X m _l, x) G C}. 

The problem is to find x\ G %\, ... , x m G T-L m such that 

xi G Argmin g l (x,x 2 , ■ ■ ■ ,x m ) 

x£Q 1 (x2,---,Xm) 



x m G Argmin g m (xi, . . . 

^^Qmi^l ' • ■ •v^m — 1 ) 



(4.11) 



The solutions to Example 14.41 are called generalized Nash equilibria [10], social equilibria 
[9] , or equilibria of abstract economies pQ , and their existence has been studied in [lj [9] . We 
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deduce from Proposition 13.11 that we can find a solution to Example 14.41 by solving a varia- 
tional inequality in ~H, provided the latter has solutions. This observation is also made in |10j . 
which investigates a Euclidean setting in which additional smoothness properties are imposed on 
iSi)l<i<m- An alternative approach for solving Example 14.41 in Euclidean spaces is also proposed 
in [12] with stronger differentiability properties on (<7j)i<j< m and a monotonicity assumption of 
the form (|4.9|) . However, the convergence of the method is not guaranteed. Below we derive 
from Section 13.21 a weakly convergent method for solving Example 14.41 



(4.12) 



(4.13) 



Proposition 4.5 In Example \4-4\ suppose that there exist (zi, . . . ,z m ) S H such that 

- Vi i Zm } 

and x £ ]0, +oo[ such that 

(V(xi, . . . , x m ) g H)(V(yi, . .. ,y m ) e H) 

m m 

W^idiixi,-- -,x m )- Vi9i(yi, ■ ■ ■ ,y m )\\ 2 < x 2 ^2\\xi - yi\\ 2 - 

i=l i=l 

Let e € ]0,l/(x + l)[ and let (7 n )neN be a sequence in [e, (1 — e)/x\- Moreover, for every i 6 
{1, ...,m}, let Xifl € Hi, and let (a^rOneN; (bi, n )neN, and (cj jn ) rag N be absolutely summable 
sequences in Hi. Now consider the following routine. 

For i = 1, . . . , m 

|_ yi,n — X j )n 7n ( Vj 9i(.Xl,ni • 
(Pl,n, • • • ,Pm,n) = Pc(yi,n, ■ ■ 

For i = 1, . . . , m 

qi,n = Pi,n - 7n(Vi ffi(pi,n, ■ 
Xi^n+1 — 2-i,n yi,n Qi,n- 

Then there exists a solution (x\, . . . ,x m ) to Example\ 

Xiri ^ Xi and Pi n ^ X%. 



(Vn € N) 



, y m ,n) + (bl ,nt ■ ■ ■ ; ^m,n) 
• • > Pm,n) "I" Cj,n) 



(4.14) 



such that, for every i € {1, . . . ,m}, 



Proof. Example 14.41 corresponds to the particular instance of Problem 11.11 in which f = ic- 
Hence, since Pq = proxj, the result follows from Theorem 13.31 □ 



4.3 Cyclic proximation problem 



We consider the following problem in "K = Hi 



Example 4.6 Let Q be a real Hilbert space, let / € Yq{T-L), and, for every i € {1, . . . ,m}, let 
Li : Hi — > Q be a bounded linear operator. The problem is to find x\ 6 ~Hi, ■ ■ ■ , x m € H m such 
that 

1 



xi £ Argmin f(x, x 2 , ■ ■ ■ ,x m ) + -\\Lix - L 2 x 2 \ 
xeHi 2 

x 2 G Argmin f(xi,x, . . . ,x m ) + -\\L 2 x - L 3 x 3 \ 



x m G Argmin f(x x , . . . ,x m -i,x) + -\\L m x - L x xi\ 



(4.15) 
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For every i G {1, . . . ,m}, the individual penalty function of player i models his desire 
to keep some linear transformation Li of his strategy close to some linear transformation of 
that of the next player i + 1. In the particular case when /: (xj)i<j< m h4 Yl^Li fi( x i)-> a 
similar formulation is studied in [2j Section 3.1], where an algorithm is proposed for solving 
(I4.15p . However, each step of the algorithm involves the proximity operator of a sum of convex 
functions, which is extremely difficult to implement numerically. The method described below 
circumvents this difficulty 



Proposition 4.7 In Example \4-6j suppose that there exists (z\,. . . , z m ) G H such that 

[L\{L 2 Z2 - Lizi), L* m {LxZ\ - L m z m )) G df(z\, . . . , z m ). (4.16) 

Set x = 2maxi<j< m ||Li|| 2 , let e G ]0, 2/(x + 1)[ an d let (7 n )neN be a, sequence in [e, (2 — e)/\\- 
For every i G {1, . . . ,m}, let x^o G Hi, and let (aj in ) ne N and (&i,n)n<=N be absolutely summable 
sequences in Hi. Now set L rn+ i = L\, for every n G N, set x m+ i^ n = xi <n , and consider the 
following routine. 



(Vn G N) 



For i = 1, ... ,m 

lVi,n = %i,n ~ Jn{L*(LiXi, n - L i+ iX i+ i jn ) + a i>n ) (4-17) 
_ (xi,„+i, . . . , x m . n+ i) = prox 7ri/ (yi 

ru • • • j Um.n ?!)•••) b m n ). 



Then there exists a solution (x%, . . . , x m ) to Example \4-6\ such that, for every i G {1, . . . , m}, 
Xi,n L*{Li(x iin -Xi) - Li + i(x i+lt n -Xj+l)) -)■ 0. 

Proof. Note that Example 14.61 corresponds to the particular instance of Problem ll.il in which, for 
every £ G {1, . . . ,m}, g { : (xj)i<i< m h-> ||LjXj - ||/2, where we set x m+ i = x\. Indeed, 

since 

{Vig^xi, . . .,x m ) = L\(LiXi - L 2 x 2 ) 
: (4.18) 
Vjti Q m {x\, . . . , x m ) — L rn {L m x rn i/iXi), 
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the operator (xj)i<j< m (->• (Vj <7j(xi, . . . , x m ))i<i< m is linear and bounded. Thus, for every 

\X\) ■ ■ ■ , X m ) G 



j=l 8=1 



^ (Viflj(xi, . . . ,x m ) | Xj) = y j (L*(LiXi - L i+1 x i+1 ) | Xi) 

8=1 

m 

i=i 

l^i+l | LiXi) 

i=l 8=1 

^ m ^ m m 

- 11-LiXill 2 + - ||L i+ ix m || 2 - ^ (L i+ iac i+a | L;X;) 

i=l 8=1 i=l 

-^\\L%Xi — Lj + iXj + i|| 2 



2' 

8=1 

m . 

= y^ 2IIL II 2 H^ll 2 ^* 3 '* ~~ ^i+l^i+lll 2 
8=1 " 

m 

8=1 

m 

= X" 1 ^l|V iffi (x 1 ,...,x m )|| 2 , (4.19) 

8=1 

and hence (f3TT5|) and ([OD hold. In addition, P~T6j) yields ([37T4"]) . Altogether, since (f3TT6|) 
reduces to (|4.17|) . the result follows from Theorem 13. 4[ □ 

We present below an application of Proposition 14.71 to cyclic proximation problems and, 
in particular, to cyclic projection problems. 

Example 4.8 We apply Example 14.61 to cyclic evaluations of proximity operators. For every 
i G {1, ... ,m}, let Hi = H, let fa G T (7i), let U = Id , and set /: (xj)i<j< m i-> Ya=i fi{ x i)- In 
view of (|2.2p . Example 14.61 reduces to finding xi £?{,..., x m G % such that 



xi = prox^ x 2 
x 2 = prox /2 x 3 

{x m = prox /m xi. 



(4.20) 



It is assumed that (|4.20p has at least one solution. Since prox^: (xj)i<j< m h-> (proxy. Xj)i<j< m 
[SJ Proposition 23.30], (|4.17p becomes (we set errors to zero for simplicity) 



(Vn G N) 



Fori=l,...,m 

[ Xj jn+ i = prox 7n/j ((l - 7 n )x ijn + J n Xi+l,n), 



where (xifi)i<i< m G % m and (7 n )neN is a sequence in [e, 1 — e] for some arbitrary e G ]0, l/2[. 
Proposition 14.71 asserts that the sequences (xi in )n€N, ■ ■ ■ , (^m,n)neN generated by (|4.21|) converge 
weakly to points x\ G H, . . . ,x m G H, respectively, such that (xi, . . . , x m ) is a solution to (fOOj) . 
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In the particular case when, for every i € {1, ...,m}, /j = id, a solution of ([4.20ft 
represents a cycle of points in C\, . . . , C m . It can be interpreted as a Nash equilibrium of the 
game in which, for every i € {1, . . . , m}, the strategies of player i, belong to Cj and its penalty 
function is (xj)i<j< m h-> — Xi + \ || 2 , that is, player i wants to have strategies as close as possible 
to the strategies of player i + 1. Such schemes go back at least to [11]. It has recently been 
proved [3] that, in this case, if m > 2, the cycles are not minimizers of any potential, from which 
we infer that this problem cannot be reduced to a potential game. Note that (|4,2ip becomes 



(Vn G 



Fori = l,...,m 

[ X iyH+ i = P Cl ((1 - Jn)Xi,n + 7n^i+l,n) 



and the sequences thus generated (aq jn )neN, • • • , (x m , n )neN converge weakly to points x\ € 
H,...,x m € H, respectively, such that (xi,... cycle. The existence of cycles has 

been proved in [11] when one of the sets C\, . . . ,C m is bounded. Thus, (|4.22p is an alternative 
parallel algorithm to the method of successive projections [11] . 
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